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In the Claims: 

Please amend the claims as follows: 

1. (Currently Amended) Method for performing event detection and object 
tracking in an image stream, wherein an event is defined as the 
occurrence of a type of activity in field which requires some type of action 
in response thereto, said method comprising: 

a) installing in the field, an image acquisition device for acquiring an 
image stream and comprising a local programmable processor for 
converting the acquired image stream, consisting of one or more 
images, to a digital format, and a local encoder, preprogrammed to 
operate with an image processing server via a data network on the 
basis of distribution of image processing algorithms between the 
local encoder and the server, said local encoder being operable to 
apply low-level feature extraction to the digital format of said image 
stream, fef and upon identifying that a number and type of features 
in the image stream exceed corresponding threshold, selectively 
generating, from said image stream^ a feature stream including 
parameters related to attributes of areas in said image stream, for 
transmitting the said feature stream via the data network to the 
image processing server; and 

b) connecting said image acquisition device to the data network 
through a corresponding data communication channel, to enable 
the operation of the encoder by the image processing server and 
transmission of the feature steam from the image acquisition device 
to the image processing server, thereby actuating high-level 
processing applications at the image processing server applied to 
the feature stream to detect the event and obtain an indication 
about the detected event: and 
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c) transmitting the indications from the image processing server to an 
operator . 

2. (Previously Amended) Method according to claim 1 , wherein the local 
encoder is a composite encoder, which comprises circuitry for compressing the 
image stream, and further comprising: 

a) operating said composite encoder in a first mode, during which it 
generates and transmits said feature stream to said image processing server, 
and 

b) operating said composite encoder in a second mode responsive to 
detecting said events, during which it transmits to said image processing server, 
in addition to said feature stream, at least a portion of said image stream in a 
desired compression level, according to commands sent from said image 
processing server. 

3. (Cancelled) 

4. (Original) Method according to claim 1 , further comprising decoding 
one or more compressed image streams containing events by said server, and 
transmitting the decoded image streams to the display of an operator, for 
viewing. 

5. (Previously Presented) Method according to claim 2, further 
comprising recording one or more compressed image streams obtained while 
said local encoder operates in said second mode. 
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6. (Original) Method according to claim 2, further comprising dynamically 
allocating additional image processing resources, in the server, to data 
communication channels that receive image streams. 

7. (Cancelled) 

8. (Previously Amended) Method according to claim 6, further 
comprising generating and displaying a graphical polygon that encompasses an 
object of interest, being within at least one of a frame of an image and an area of 
interest in said image. 

9. (Previously Amended) Method according to claim 8, further 
comprising generating and displaying a graphical trace indicating the history of 
movement of an object of interest, being within at least one of the frame of an 
image and an area of interest in said image. 

1 0. (Previously Amended) Method according to claim 1 , wherein the 
image stream is selected from a group of images that comprises video streams, 
still images, computer generated images, pre-recorded digital video data and 
analog video data. 

1 1 . (Original) Method according to claim 1 , wherein the image streams are 
video streams, compressed using MPEG format. 

12. (Cancelled) 

1 3. (Previously Amended) Method according to claim 1 , wherein the 
feature stream includes at least one of: 

a motion feature; 



4 



Application Serial No.: 10/501,949 
Attorney Docket No.: 014787.0005 



foreground feature 

a color feature; 

edge data; and 

frequency related information. 

14. (Previously Amended) Method according to claim 1 , further 
comprising performing, by the server, at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection, 

using the feature stream received from the image acquisition device, 
through the data communication channel. 

1 5. (Currently Amended) System for use in performing event detection and 
object tracking in image streams, wherein an event is defined as the occurrence 
of a type of activity in field which requires some type of action in response 
thereto, said system comprising: 

a) an image acquisition device for installation in the field, the image 
acquisition device comprising: 

a. 1 ) a local programmable processor for converting the acquired 
image stream to a digital format; and 

a. 2) a local encoder, preprogrammed to operate with an image 
processing server via a data network on the basis of 
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distribution of image processing algorithms between the 
image acquisition device and the server, said local encoder 
being operable for applying a low-level feature extraction to 
the image stream and, upon identifying that a number and 
type of features in the image stream exceed corresponding 
threshold, selectively generating, from said image stream, a 
feature stream including parameters related to attributes of 
areas in said image stream; 

b) a data communication channel connecting the image acquisition 
device to the data network and operable for transmitting the feature 
stream generated by the local encoder to the image processing 
server, thereby actuating high-level processing applications at the 
image processing server to detect the event in the field; 

c) a remote image processing server connected to said data network, 
said remote image processing server receiving said feature stream 
transmitted by said local encoder; and 

d) said remote image processing server applying a high-level 
processing to the received feature stream and detecting said event 
from analyzing said feature stream, and transmitting indications 
regarding said event to an operator. 

16. (Previously Amended) System according to claim 15, wherein said local 
encoder is a composite encoder and further comprises circuitry for compressing 
said image stream, said composite encoder having a first operating mode, during 
which it generates and transmits said feature stream to said remote image 
processing server, and having a second operating mode, during which said 
composite encoder transmits to said remote image processing server, in addition 
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to said feature stream, at least a portion of said image stream in a desired 
compression level, according to commands sent from said remote image 
processing server. 

1 7. (Previously Amended) System according to claim 1 6, further 
comprising the remote image processing server decoding said portion of said 
image stream and determining said portion of said image stream contains an 
event; and 

an operator display, for receiving said portion of said image steam, 
containing the event from the remote image processing server. 

18. (Previously Amended) System according to claim 16, further 
comprising a network video recorder for recording one or more image streams T 
obtained while said composite encoder operates in said second mode. 

19. (Previously Amended) System according to claim 17, in which the 
remote image processing server is capable of dynamically allocating image 
processing resources to said data communication channel when said data 
communication channel receives said portion of said image stream. 

20. (Previously Amended) System according to claim 16, in which said 
portion of said image stream obtained while operating in the second mode, 
comprises only a portion of the image that corresponds to a desired area of 
interest. 

21 . (Previously Amended) System according to claim 17, in which the 
remote image processing server further comprises processing means for 
generating and displaying a graphical polygon that encompasses an object of 
interest, being within at least one of a frame of an image and an area of interest 
in said image when said composite encoder is in said second operating mode. 
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22. (Previously Amended) System according to claim 21 , in which the 
remote image processing server further comprises processing means for 
generating and displaying a graphical trace indicating the history of movement of 
an object of interest, being within at least one of the frame of said image and the 
area of interest of said image. 

23. (Original) System according to claim 15, in which the image stream is 
selected from the group of images that comprises video streams, still images, 
computer generated images, and pre-recorded digital or analog video data. 

24. (Previously Amended) System according to claim 15, in which the 
image stream is a video stream compressed using MPEG format. 

25. (Cancelled) 

26. (Previously Amended) System according to claim 15, in which the 
feature stream includes at least one of: 

a motion feature; 

a color feature; 

edge data; and 

frequency related information. 

27. (Previously Amended) System according to claim 17, in which the 
remote image processing server further comprises processing means for 
performing at least one of: 

License Plate Recognition (LPR); 
Facial Recognition (FR); 
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detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using the feature stream T received from the local encoder of the image 
acquisition device, through the data communication channel. 

28. (Canceled) 

29. (Canceled) 

30. (Previously Amended) Method according to claim 1 wherein said 
feature stream further comprises a motion feature, said motion feature being 
encoded in said feature stream only when said motion feature exceeds a 
predetermined threshold. 

31 . (Previously Amended) System according to claim 15 wherein said feature 
stream further comprises a motion feature, said motion feature being encoded in 
said feature stream only when said motion feature exceeds a predetermined 
threshold. 

32. (Currently Amended) A distributed image processing method for 
effectively performing event detection in a large number of concurrent image 
sequences, wherein an event is defined as the occurrence of a type of activity in 
fields which requires some type of action in response thereto, said method 
comprising: 
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a) performing low level feature extraction by encoders associated with 
image acquisition devices installed in the fields, said low level feature extraction 
comprising: 

i) receiving image streams from the image acquisition devices 
installed in the fields and generating digital data indicative thereof; 

ii) processing the digital data indicative of the image stream^ 
said processing comprising feature extraction and , upon identifying that a 
number and type of features in the image stream exceed a corresponding 
threshold, selectively e xtract i ng th e r e from generating a corresponding features 
stream having a bandwidth narrower than that of the corresponding image 
stream, features in said feature stream including parameters related to attributes 
of areas in the respective said image stream; 

m) pr i or to d e t e ct i ng Go i d o v o nt, g o n o rat i ng a r e duc e d 

bandw i dth non i mago footuro stroam for oach ca i d i mago otroam, oa i d roducod 
bandw i dth non i mago foaturo otroam baood upon oa i d foaturoo; 

b) transmitting said reduced bandwidth feature stream from the image 
acquisition devices to a common remote image processing server, thereby 
actuating the image processing server for p e rform i ng applying high level image 
processing to the feature stream and detecting events in the fields , and 
transmitting indications regarding said events to an operator . 

33. (Previously Amended) The method of claim 32 further comprising 
transmitting to said remote image processing server at least a portion of an 
image stream from any of said plurality of image acquisition devices associated 
with the reduced bandwidth feature stream in which said remote image 
processing server detects an event. 
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34. (Previously Amended) The method of claim 33, wherein said high level 
image processing comprises: receiving said reduced bandwidth feature stream 
transmitted from each of said plurality of image acquisition devices, analyzing 
each said reduced bandwidth feature stream at said remote image processing 
server, and detecting events in each said image stream based upon said 
analyzing of each said reduced bandwidth feature stream by said remote image 
processing server, and displaying said image stream in which an event is 
indicated on a display screen of an operator at said remote image processing 
server. 

35. (Previously Amended) The method of claim 32 wherein said selective 
extraction comprises selectively encoding features in said reduced bandwidth 
non -i mag e feature stream only when at least one of a number and type of said 
features exceed a predetermined threshold, wherein said threshold is applied to 
said image acquisition device to control when said encoder generates and 
transmits said feature stream, and said number and type of features exceeding 
said threshold are indicative of activity to be further analyzed by said remote 
image processing server in order to detect said event. 

36. (Previously Amended) The method of claim 35 wherein said transmitting 
said reduced bandwidth feature stream to said remote image processing server 
occurs only when said number and type of features exceed said predetermined 
threshold. 

37. (Previously Amended) The method of claim 35 wherein said features 
further comprise motion features, and said motion features are encoded in said 
reduced bandwidth feature stream only when said motion features exceed said 
predetermined threshold. 
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38. (Previously Presented) The method of claim 35 wherein said 
predetermined threshold is set by said remote server. 

39. (Previously Presented) The method of claim 32 further comprises 
recording said image stream when said event is detected therein. 

40. (Previously Amended) The method of claim 35 further comprising 
transmitting to said remote image processing server at least a portion of an 
image stream from any of said plurality of image acquisition devices associated 
with the reduced bandwidth feature stream in which said remote image 
processing server detects an event. 

41 . (Previously Amended) The method of claim 40 further comprising 
generating and displaying a graphical polygon that encompasses an object of 
interest within at least one of a frame of said at least a portion of an image and 
an area of interest in said at least a portion of an image. 

42. (Previously Presented) The method of claim 41 further comprising 
generating and displaying a graphical trace indicating the history of movement of 
said object of interest. 

43. (Previously Amended) The method of claim 32 wherein said image 
stream is selected from a group of images comprising video streams, still 
images, computer generated images, pre-recorded digital video data and pre- 
recorded analog video data. 

44. (Previously Amended) The method of claim 32 wherein said features 
stream comprises at least one of: 

a motion feature; 
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a color feature; 
edge data; and 
frequency related information. 

45. (Previously Amended) The method of claim 34 wherein said high level 
image processing comprises performing, by said remote image processing 
server, at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using said reduced bandwidth feature stream received from at least one of 
said plurality of image acquisition devices. 

46. (Currently Amended) A distributed image processing system for effectively 
performing event detection in a large number of concurrent image sequences, 
said distributed image processing system having an in field component and a 
remote component, wherein an event is defined as the occurrence of a type of 
activity which requires some type of action in response thereto, said distributed 
image processing system comprising: 

a) a low level feature extraction component located in field, said low 
level feature extraction component comprising: 

a plurality of image acquisition devices installed in field, each 
producing an image stream; 
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a processor and an encoder associated with each of said plurality 
of image acquisition devices; 

said processor converting said image stream to a digital format; 

said encoder applying a low-level feature extraction to the image 
stream and upon identifying that a number and type of features in the image 
stream exceed corresponding threshold selectively extract i ng foaturo data from 
sa i d i mago stream and generating from the image stream a reduced bandwidth 
feature stream th e r e from, sa i d f e atur e data including parameters related to 
attributes of areas in said image stream; 

b) a remote high level image processing component comprising a 
remote image processing server; 

c) a data network with which said low level feature extraction 
component communicates with said remote image processing server, each of 
said plurality of image acquisition devices and associated encoders 
communicating with said data network through a corresponding data 
communication channel; 

d) said encoder transmitting said reduced bandwidth feature stream to 
said remote image processing server for d e t e ct i on of an e v e nt ; 

e) said remote image processing server analyzing said reduced 
bandwidth feature stream and th e r e by d etecting said events associated with said 
image stream; and 

f) wherein, r e spons i v e to upon detecting said event from the feature 
stream , said remote image processing server causes at least a portion of said 
the corresponding image stream associated with said events to be transmitted to 
said remote image processing server. 
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47. (Previously Amended) The system of claim 46 wherein said encoder 
comprises a composite encoder which incorporates said processor, and further 
comprises circuitry for compressing said image stream, said composite encoder 
having a first operating mode during which said composite encoder transmits 
said reduced bandwidth feature stream to said remote image processing server, 
and a second operating mode during which said composite encoder transmits to 
said remote image processing server, in addition to said reduced bandwidth 
feature stream, at least a portion of said image stream in a desired compression 
level, according to commands sent from said remote image processing server, 
said remote image processing server controlling said composite encoder to 
operate in said second operating mode responsive to detecting said events. 

48. (Canceled) 

49. (Previously Amended) The system of claim 47 further comprising an 
operator display for receiving from said remote image processing server said 
image stream in which said event is detected. 

50. (Previously Amended) The system of claim 46 wherein said features are 
encoded in said reduced bandwidth feature stream only when at least one of a 
number and type of said features exceed a predetermined threshold, wherein 
said threshold is applied to said image acquisition device to control when said 
encoder generates and transmits said feature stream, and said number and type 
of features exceeding said threshold are indicative of activity to be further 
analyzed by said remote image processing server in order to detect said event. 

51 (Previously Amended) The method of claim 50 wherein said reduced 
bandwidth feature stream is transmitted to said remote image processing server 
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only when said number and type of features exceed said predetermined 
threshold. 

52. (Previously Amended) The system of claim 50 wherein said features 
further comprise motion features, and said motion features are encoded in said 
reduced bandwidth feature stream only when said motion features exceed said 
predetermined threshold. 

53. (Previously Presented) The system of claim 50 wherein said 
predetermined threshold is established by said remote image processing server. 

54. (Previously Amended) The system of claim 47 further comprising a 
network video recorder associated with each of said plurality of image acquisition 
devices for recording said image stream when said composite encoder operates 
in said second operating mode. 

55. (Previously Presented) The system of claim 47 wherein said remote 
image processing server dynamically allocates additional image processing 
resources to data communication channels receiving said image stream. 

56. (Cancelled) 

57. (Previously Amended) The system of claim 49 wherein said remote 
image processing server further comprises a programmable processor for 
generating and displaying on said operator display a graphical polygon that 
encompasses an object of interest within at least one of a frame of said at least a 
portion of an image and an area of interest in said at least a portion of an image. 
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58. (Previously Presented) The system of claim 57 wherein said remote 
image processing server generates and displays on said operator display a 
graphical trace indicating a history of movement of said object of interest. 

59. (Previously Amended) The system of claim 46 wherein said image 
stream is selected from a group of images comprising video streams, still 
images, computer generated images, pre-recorded digital video data and pre- 
recorded analog video data. 

60. (Previously Amended) The system of claim 46 wherein said features 
stream comprises at least one of: 

a motion feature; 

a color feature; 

edge data; and 

frequency related information. 

61 . (Previously Amended) The system of claim 46 wherein said remote 
image processing server performs at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using said reduced bandwidth feature stream. 
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62. (Currently Amended) Method for use in performing event detection 
and object tracking in image streams using a system formed by a set of image 
acquisition devices, each installed in field where an event is to be detected and 
connected to a central station through a data network, the method comprising: 

processing a digital format of an image stream, consisting of 
one or more images, to detect features, being parameters related to attributes of 
objects in said image stream, and, based on these features, performing the event 
detection and object tracking, wherein 

providing an image processing server remote from the field, said 
image processing server being preprogrammed to operate with each of the 
image acquisition devices on the basis of distribution of image processing 
algorithms between the image acquisition device and the server, said image 
processing server being preprogrammed for performing said distribution of image 
processing algorithms by carrying out the following: 

dynamically determining a threshold value for each feature, 
which is associated with the event to be detected and which is to be extracted by 
the set of image acquisition devices from image data acquired thereby in the 
field, and updating each of the image acquisition devices with the corresponding 
threshold, thereby enabling the image acquisition device to apply low-level 
feature extraction to the image stream and selectively generate a features stream 
upon identifying that a number and type of features in the image stream exceed 
the corresponding threshold, in response to a feature stream, received from each 
of the image acquisition devices via the network, applying a high-level processing 
to the received feature stream to identify events in an image date stream to 
which said feature stream corresponds, and controlling an operational mode of 
the respective image acquisition device, to thereby enable transmission of output 
data to an operator. 

63. (Currently amended) A non-transitory computer readable medium for 
use in performing event detection and extraction and object tracking, the 
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computer readable medium containing instructions which, when executed by a 
processor, cause the processor to operate with each of multiple remote image 
acquisition devices via a communication network on the basis of distribution of 
image processing algorithms between the image acquisition device and said 
processor, by selectively carrying out the following: 

dynamically determining a threshold value for each of a plurality 
of predetermined features, which are parameters related to attributes of objects 
in an image stream to be captured by at least one of the remote image 
acquisition devices, and are associated with the event to be detected and 
extracted by the respective image acquisition device from image data acquired 
thereby in the field, and updating each of the image acquisition devices with the 
corresponding threshold, thereby enabling the image acquisition device to apply 
low-level feature extraction to the image stream and selectively generate a 
features stream upon identifying that a number and type of the features in the 
image stream exceed the corresponding threshold , in response to a feature 
stream, received from at least one of the image acquisition devices via the 
network, processing the feature stream by applying a high-level processing to the 
received feature stream to identify events in an image date stream to which said 
feature stream corresponds, and controlling an operational mode of the 
respective image acquisition device, to thereby enable transmission of output 
data to an operator. 

64. (Currently Amended) System for use in performing event detection 
and object tracking in image streams, the system comprising an image 
processing server configured for connecting via a data network to a set of image 
acquisition devices each located in field where the event detection is to be 
performed, said image processing server being preprogrammed to operate with 
each of the image acquisition devices on the basis of distribution of image 
processing algorithms between the image acquisition devices and the image 
processing server, by determining and providing to each of the image acquisition 
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devices a corresponding threshold for each feature that is associated with the 
event to be detected and is to be extracted by the image acquisition devices from 
image data acquired thereby and enabling the image acquisition device to apply 
low-level feature extraction to at least one of the image streams and selectively 
generate a feature stream corresponding to the image stream upon identifying 
that a number and type of the features in the image stream exceed the 
corresponding threshold , the image processing server being responsive to a 
feature stream, received from each of the image acquisition devices for applying 
high-level processing to the received feature stream, to control an operational 
mode of the respective image acquisition device and to identify event in the 
image date stream corresponding to the feature stream, to thereby enable 
transmission of output data to an operator. 

65. (Currently amended) A non-transitorv computer program, embodied 
on a computer readable medium, for use in performing event detection and 
object tracking in image streams, comprising computer program code means 
which, when run on a computer causes the computer to: 

connect, via a data network, an image processing server to a 
set of image acquisition devices, each located in field where the event detection 
is to be performed; and 

cause the image processing server to operate with each of the 
image acquisition devices on the basis of distribution of image processing 
algorithms between the image acquisition devices and the image processing 
server by determining and providing to each of the image acquisition devices a 
corresponding threshold for each feature that is associated with the event to be 
detected and is to be extracted by the image acquisition devices from at least 
one of the image date streams acquired thereby and enabling the image 
acquisition device to apply low-level feature extraction to the image stream and 
selectively generate a feature stream corresponding to one of the image streams 
upon identifying that a number and type of the features in the image stream 
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exceed the corresponding threshold , the image processing server being 
responsive to a feature stream, received from each of the image acquisition 
devices for applying high-level processing to the received feature stream, to 
control an operational mode of the respective image acquisition device and to 
identify the event in the image dat a stream corresponding to the feature stream, 
to thereby enable transmission of output data to an operator. 

66. (Previously Presented) The computer program as claimed in Claim 65 
embedded on a computer readable medium. 
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